Applying holographic effects to prints

ABSTRACT

Lighting information comprising at least the reflectance data of a plurality of regions of an object surface is generated and printed out as a series of relightable holograms. Each of the printed holograms comprises the reflectance data of a corresponding region of the object. A model of the object is generated such that the model also comprises a plurality of portions corresponding to the regions of the object surface. The series of holograms are each affixed to a portion of the model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is affixed to the corresponding portion of the model. In an embodiment, the model of the object is generated from a metal. The series of holograms is engraved directly onto the metallic model such that a particular hologram of the series which encodes the reflectance data of a particular region of the object is engraved onto the corresponding portion of the metallic model.

CROSS REFERENCES TO RELATED APPLICATIONS

This application is related to U.S. application Ser. No. 14/670,344titled “RECORDING HOLOGRAPHIC DATA ON REFLECTIVE SURFACES” filed on adate even herewith and U.S. application Ser. No. 14/670,327 titled“RELIGHTABLE HOLOGRAMS” filed on a date even herewith. The entiredisclosures of these applications are incorporated herein by reference.

The present disclosure relates to applying holographic effects to twodimensional and three dimensional prints.

BACKGROUND

Traditional two dimensional printers used by computers print out datarow-by-row on a paper. When this method of printing was extended toprint multiple layers one on top of another, it enabled printing ofthree dimensional models. Three dimensional (3D) printing is a processby which a computer model is translated into a physical object. Unliketraditional processes that create models via primarily subtractiveprocesses of chiseling away material, 3D printing is an additive processwherein the physical object is built up with multiple layers ofmaterials. As a result there is less wastage of material in addition toeliminating expensive re-tooling required to produce different modelsunder the traditional subtractive processes. The additive processes arecarried out by a 3D printer under the control of a computing device thatcomprises modules to carry out the printing procedure. This enablesobtaining models quickly and economically before producing the actualobject in a factory. As the technology matured, 3D printers areincreasingly used not only to print simple models but also to printvarious products such as models of sophisticated machinery parts,pharmaceutical tablets or even dental crowns used by dentists.

SUMMARY

This disclosure is related to systems and methods for generating modelsof objects that comprise not only the depth information but also thelighting information of the object surface. A method of generating amodel of an object is disclosed in some embodiments. The method can beexecuted by a device comprising one or more processors. The methodcomprises receiving, at the device comprising the processor, a series ofprinted holograms, each printed hologram comprising at least oneholographic pixel that encodes lighting information of one of aplurality of regions of an object surface. The object can be a realobject or a virtual object. The device prints a physical model of theobject wherein a surface of the physical model comprises a plurality ofportions each of which corresponds to a respective one of the pluralityof regions of the object. In some embodiments, the model of the objectis a 2-dimensional model. In some embodiments, the model of the objectis a 3-dimensional model. In some embodiments, printing a physical modelof the object further comprises receiving, by the device, a threedimensional image of the object and printing the three dimensional modelof the of the object from the three dimensional image.

In some embodiments, the series of printed holograms are attached to thephysical model such that each printed hologram is attached to thatportion of the physical model which corresponds to a respective regionof the object surface whose lighting information is encoded in theattached printed hologram. In some embodiments, a holographic sheetcomprising at least a subset of the series of printed holograms iswrapped on the model. In some embodiments, each of the plurality ofprinted holograms is affixed to the respective portions of the modelsurface during the printing. In some embodiments, the printed series ofholograms are relightable holograms. In some embodiments, an area ofeach portion of the printed hologram ranges between 0.000001 sq. mm. to0.25 sq. mm.

In some embodiments, a holographic sheet comprising the series ofprinted holograms is disclosed. The sheet is divided into a plurality ofprinted holograms wherein each printed hologram comprises at least onehologram of the series. Each of the plurality of printed holograms isattached to that portion of the physical model which corresponds to arespective region of the object surface whose lighting is encoded in theattached printed hologram.

An apparatus comprising a processor and a storage medium for tangiblystoring thereon program logic for execution by the processor forgenerating a model of an object is disclosed in some embodiments. Theprogram logic comprises, receiving logic, executed by the processor, forreceiving at the apparatus, a series of printed holograms, each printedhologram comprises at least one holographic pixel that encodes lightinginformation of one of a plurality of regions of an object surface. Insome embodiments, the programming logic comprises, printing logic,executed by the processor, for printing a physical model of the objectwherein a surface of the physical model comprises a plurality ofportions, each of which corresponds to a respective one of the pluralityof object regions. The programming logic further comprises attachinglogic, executed by the processor, for attaching the series of printedholograms to the physical model, each printed hologram is attached tothat portion of the physical model which corresponds to a respectiveregion of the object surface whose lighting information is encoded inthe attached printed hologram. In some embodiments the attaching logiccomprises logic executed by the processor for wrapping a holographicsheet comprising at least two of the series of printed holograms on themodel.

In some embodiments, the processor further executes dividing logic fordividing a holographic sheet comprising the series of printed hologramsinto a plurality of printed holograms wherein each printed hologramcomprises at least one hologram of the series. The processor alsoexecutes applying logic for applying each of the plurality of printedholograms to that portion of the physical model which corresponds to arespective region of the object surface whose lighting is encoded in theattached printed hologram. In some embodiments, the processor executesimage receiving logic for receiving a three dimensional image of theobject and logic is executed by the processor for printing the threedimensional model of the object from the three dimensional image.

A non-transitory computer readable medium comprisingprocessor-executable instructions is disclosed in one embodiment. Theinstructions comprise instructions for receiving a series of printedholograms, each printed hologram comprising at least one holographicpixel that encodes lighting information of one of a plurality of regionsof an object surface. The instructions further include instructions forprinting a physical model of the object wherein a surface of thephysical model comprises a plurality of portions each of whichcorresponds to a respective one of the plurality of regions andinstructions for attaching the series of printed holograms to thephysical model. The instructions cause each printed hologram to beattached to that portion of the physical model which corresponds to arespective region of the object surface whose lighting information isencoded in the attached printed hologram.

In some embodiments, the instructions for attaching the printed seriesof holograms to the model further comprise processor-executableinstructions for wrapping a holographic sheet comprising at least asubset of the series of printed holograms on the model. In someembodiments, the instructions for attaching the printed series ofholograms to the model further comprise processor-executableinstructions for dividing a holographic sheet comprising the series ofprinted holograms into a plurality of printed holograms wherein eachprinted hologram comprises at least one hologram of the series andinstructions for applying each of the plurality of printed holograms tothat portion of the physical model which corresponds to a respectiveregion of the object surface whose lighting is encoded in the attachedprinted hologram.

A model of an object is disclosed in some embodiments. The modelcomprises a plurality of portions wherein each portion of the modelcorresponds to a respective one of a plurality of regions of the object.The model further comprises a plurality of holographic prints affixed tothe plurality of model portions, wherein each of the holographic printscomprises lighting information of a respective one of the plurality ofregions of the object. At least one of the plurality of holographicprints is affixed to one of the plurality of model portions thatcorresponds to the respective one of the plurality of regions of theobject for which the lighting information is comprised in the at leastone holographic print. In some embodiments, the lighting informationcomprised in the at least one holographic print is a bi-directionalreflectance distribution function (BRDF) of the respective one of theplurality of object regions. An area of each of the holographic printsranges between 0.000001 sq. mm. to 0.25 sq. mm. The model of the objectcan be a two-dimensional model or a three-dimensional model. In someembodiments, the properties of light reflected from a surface of themodel are similar to properties of light reflected from a surface of theobject.

A method of generating a 3D model of an object is disclosed in anembodiment. The method comprises obtaining a metallic model of anobject. The object comprises a plurality of regions. The model is madeof metal and also comprises a plurality of portions such that eachportion of the model corresponds to a respective one of the regions ofthe object. In an embodiment, a first processor receives lightinginformation of the object wherein the lighting information comprisesreflectance data of the object regions. The lighting information of theobject is printed by the first processor, as a series of holograms, eachhologram of the series comprising at least one holographic pixel thatencodes the reflectance data of a respective one of the object regions.Each hologram is printed on a portion of the model that corresponds tothe respective one of the object regions. In some embodiments, the modelof the object is printed by a three-dimensional printer capable ofprinting metallic models with metals such as gold or silver.

A method of generating a metallic model comprising reflectance data ofan object is disclosed in an embodiment. The method comprises,receiving, by a device comprising a processor, lighting information ofan object comprising a plurality of regions, the lighting informationcomprising reflectance data of the portions. A model of an object isprinted by the device wherein the model is made of metal and a surfaceof the model comprises a plurality of portions, each portion of themodel surface corresponding to a respective one of the regions of theobject. The lighting information of the object is transferred to themodel by the device as a series of holograms, each hologram of theseries comprising at least one holographic pixel that encodes areflectance data of a respective one of the regions and each hologram isprinted on a portion of the model that corresponds to the respectiveregion.

In some embodiments, the device receives a three-dimensional image ofthe object and prints the three-dimensional model of the object from thethree-dimensional image. Similarly, if the device receives a twodimensional image of the object a two-dimensional model of the object isprinted from the two dimensional image.

A method of producing a hologram of an object comprising a plurality ofregions is disclosed in an embodiment. The method comprises obtaining,from a single fixed viewpoint, a plurality of reflectance data sets ofthe object surface for a respective plurality of light sources. Themethod comprises further steps of illuminating the object surface withone of the plurality of light sources located at a particular positionrelative to the object and recording, a respective reflectance data ofthe object surface with the light source at the particular position. Thelight source is moved, for example, by a distance between 0.5 mm-1.0 mmto a new position adjacent to the particular position and theilluminating, the recording and the moving steps are repeated apredetermined number of times for each of the plurality of lightsources.

Aggregated reflectance data is generated by a computing device for eachregion of the object surface by overlaying reflectance data obtainedfrom the plurality of reflectance data sets for each region of theobject surface. A light sensitive medium is illuminated with theaggregated reflectance data of at least one of the plurality of regionsof the object surface and a hologram of the at least one region ismanufactured from the light sensitive medium. In some embodiments, thehologram is comprised on a substrate having a region between 0.000001sq. mm to 0.25 sq. mm.

In some embodiments, the object is a real-world object and a light stageapparatus is used to obtain the plurality of reflectance data sets. Insome embodiments, the object is a virtual object and a computing deviceis used to obtain the plurality of reflectance data sets.

A substrate comprising a diffraction structure which is a hologram isdisclosed in an embodiment. The hologram comprises a plurality of imagesof a virtual or real object overlaid on each other and each of theplurality of images encodes reflectance data of a region of the objectsurface recorded from a single view point under a respective lightingcondition. In some embodiments, the substrate extends between 0.000001sq. mm to 0.25 sq. mm. In some embodiments, the respective lightingconditions comprise at least a light source located at a respectiveposition relative to the object and the view point. A reflected ray isgenerated by the hologram from light incident on the hologram from thelight source, the reflected ray generated by the hologram has identicalproperties as a reflected ray generated by the region of the objectsurface when illuminated by the light source.

These and other embodiments will be apparent to those of ordinary skillin the art by reference to the following detailed description and theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawing figures, which are not to scale, and where like referencenumerals indicate like elements throughout the several views:

FIG. 1 is a flowchart that illustrates a methodology of generating amodel of an object in accordance with some embodiments.

FIG. 2 is a flowchart that details a methodology of generating a modelof an object in accordance with some embodiments.

FIG. 3 is a flowchart that details the method of generating a model ofan object in accordance with some embodiments.

FIG. 4 shows a flowchart that details a methodology of generating thelighting information for a relightable hologram which can be used withthe 3D printed model of the object in accordance with some embodiments.

FIG. 5 details a method of generating a relightable hologram inaccordance with some embodiments.

FIG. 6 is an illustration that depicts the lighting informationcomprising a series of images obtained for a person in accordance withsome embodiments.

FIG. 7 shows a model of an object generated in accordance withembodiments detailed herein.

FIG. 8 illustrates internal architecture of a computing device inaccordance with some embodiments.

FIG. 9 illustrates a 3D printer apparatus for printing 3D models inaccordance with some embodiments.

DESCRIPTION OF EMBODIMENTS

Subject matter will now be described more fully hereinafter withreference to the accompanying drawings, which form a part hereof, andwhich show, by way of illustration, specific example embodiments.Subject matter may, however, be embodied in a variety of different formsand, therefore, covered or claimed subject matter is intended to beconstrued as not being limited to any example embodiments set forthherein; example embodiments are provided merely to be illustrative.Likewise, a reasonably broad scope for claimed or covered subject matteris intended. Among other things, for example, subject matter may beembodied as methods, devices, components, or systems. Accordingly,embodiments may, for example, take the form of hardware, software,firmware or any combination thereof. The following detailed descriptionis, therefore, not intended to be taken in a limiting sense.

In the accompanying drawings, some features may be exaggerated to showdetails of particular components (and any size, material and similardetails shown in the figures are intended to be illustrative and notrestrictive). Therefore, specific structural and functional detailsdisclosed herein are not to be interpreted as limiting, but merely as arepresentative basis for teaching one skilled in the art to variouslyemploy the disclosed embodiments.

The present disclosure is described below with reference to blockdiagrams and operational illustrations of methods and devices to selectand present media related to a specific topic. It is understood thateach block of the block diagrams or operational illustrations, andcombinations of blocks in the block diagrams or operationalillustrations, can be implemented by means of analog or digital hardwareand computer program instructions. These computer program instructionscan be provided to a processor of a general purpose computer, specialpurpose computer, ASIC, or other programmable data processing apparatus,such that the instructions, which execute via the processor of thecomputer or other programmable data processing apparatus, implements thefunctions/acts specified in the block diagrams or operational block orblocks.

In some alternate implementations, the functions/acts noted in theblocks can occur out of the order noted in the operationalillustrations. For example, two blocks shown in succession can in factbe executed substantially concurrently or the blocks can sometimes beexecuted in the reverse order, depending upon the functionality/actsinvolved. Furthermore, the embodiments of methods presented anddescribed as flowcharts in this disclosure are provided by way ofexample in order to provide a more complete understanding of thetechnology. The disclosed methods are not limited to the operations andlogical flow presented herein. Alternative embodiments are contemplatedin which the order of the various operations is altered and in whichsub-operations described as being part of a larger operation areperformed independently.

A computing device may be capable of sending or receiving signals, suchas via a wired or wireless network, or may be capable of processing orstoring signals, such as in memory as physical memory states, and may,therefore, operate as a server. Thus, devices capable of operating as aserver may include, as examples, dedicated rack-mounted servers, desktopcomputers, laptop computers, set top boxes, integrated devices combiningvarious features, such as two or more features of the foregoing devices,or the like. Servers may vary widely in configuration or capabilities,but generally a server may include one or more central processing unitsand memory. A server may also include one or more mass storage devices,one or more power supplies, one or more wired or wireless networkinterfaces, one or more input/output interfaces, or one or moreoperating systems, such as Windows Server, Mac OS X, Unix, Linux,FreeBSD, or the like.

Throughout the specification and claims, terms may have nuanced meaningssuggested or implied in context beyond an explicitly stated meaning.Likewise, the phrase “in one embodiment” as used herein does notnecessarily refer to the same embodiment and the phrase “in anotherembodiment” as used herein does not necessarily refer to a differentembodiment. It is intended, for example, that claimed subject matterinclude combinations of example embodiments in whole or in part. Ingeneral, terminology may be understood at least in part from usage incontext. For example, terms, such as “and”, “or”, or “and/or,” as usedherein may include a variety of meanings that may depend at least inpart upon the context in which such terms are used. Typically, “or” ifused to associate a list, such as A, B or C, is intended to mean A, B,and C, here used in the inclusive sense, as well as A, B or C, here usedin the exclusive sense. In addition, the term “one or more” as usedherein, depending at least in part upon context, may be used to describeany feature, structure, or characteristic in a singular sense or may beused to describe combinations of features, structures or characteristicsin a plural sense. Similarly, terms, such as “a,” “an,” or “the,” again,may be understood to convey a singular usage or to convey a pluralusage, depending at least in part upon context. In addition, the term“based on” may be understood as not necessarily intended to convey anexclusive set of factors and may, instead, allow for existence ofadditional factors not necessarily expressly described, again, dependingat least in part on context.

Improvements in printing technology transformed two dimensional printingof data on a paper into an additive process for printingthree-dimensional models from image data fed to computers.Three-dimensional printers which are currently used buildthree-dimensional models by layering printing materials, for example,one micron at a time. Models created by three-dimensional printing cancomprise robust internal structure that would otherwise not be possiblewith regular molds. Models can be built via the three-dimensionalprinting process using different materials such as, plastic, metals orresins of different colors. Despite the availability of the variouscolors and materials for usage in three-dimensional printing, currentthree dimensional printing technologies are limited to primarilyprinting out models whose surfaces exhibit simple reflectance,Lambertian surfaces for example, which do not convey the truereflectance behavior of the actual objects being modeled.

While a three-dimensional printer may be able to model the detailedstructure of the Eiffel tower, it fails to capture in the model the truereflectance properties of the metal that makes up the actual Eiffeltower. Another example of a complex structure whose reflectanceproperties are not properly captured by the three-dimensional printer isthe human (or other species) face. A face of a living entity comprises acomplex collection of hues and shades and reflects light in complexmanner that cannot be captured even with the best high-resolutionthree-dimensional (3D) printers. For example, three-dimensional printerswith resolutions as fine as 16-30 microns are currently available. Thus,when printing a face, features such as hair and pores can be printed.However, models printed even with three-dimensional printers of thefinest resolution fail to look real despite replicating the objectstructures accurately. This is because the light-reflectance propertiesof the objects are determined by a complex set of factors which not onlyinclude the physical properties such as the microscopic surface detailsand color of the object, but also the chemical properties of the objectitself. Such details of how the object interacts with light cannot beaccurately captured by 3D printed models absent the improvements setforth herein.

Technologies currently exist for capturing and recording in detail thecomplex light reflectance properties of objects such as the face or skinof a living being. Light stage, which will be described in detailfurther infra is one example. Similarly, technologies also exist togenerate, by computing devices, the reflectance properties of theobject. For example image based relighting techniques are used forgenerating photorealistic images of objects under any lightingconditions. Applications of such techniques include inter alia,insertion of characters within a scene in a movie.

Apparatus such as the dome-like light stage or a mobile light stage isused for capturing reflectance data of an object by illuminating it fromdifferent directions. A number of images of the object are capturedwherein the object in each image is lit by light coming from a differentdirection than the other images. Hence, intensities of lights comingfrom the various directions can be captured for each pixel, whichenables reconstructing the image of the object under any other lightingconditions not captured by apparatus such as the light stage via use ofmathematical models. This can be achieved by fitting a reflectance modelto the reflectance measurements obtained from light stage for the objectsurface. In addition, a set of reflectance measurements obtained forparticular directions can be extrapolated using models such as theLambertian, Phong or Ward models to obtain intensities for incidentangles not included in the measured set.

The interaction of the various surfaces with light can be described interms of the Bi-directional Reflectance Distribution Function (BRDF). Ingeneral, the degree to which light is reflected (or transmitted) dependson the viewer and light position relative to the surface normal andtangent. Since a BRDF is indicative of how light is reflected, it mustcapture the view and light-dependent nature of reflected light.Consequently, a BRDF is a function of incoming (light) direction andoutgoing (view) direction relative to a local orientation at the lightinteraction point. However, no techniques currently exist for endowing3D printed models with the various light reflectance properties such asthose conveyed by the BRDF of the object surface.

Embodiments disclosed herein enable providing a model of an object withthe light reflectance properties of the object so that the model alsoreflects light in a manner similar to the object thereby looking morelike the actual object when compared to a model printed from aconventional 3D printer. More particularly, embodiments described hereinenable recording the light interaction properties of an object andapplying such properties to a model of the object. This endows the modelwith the light reflectance properties of the object thereby making themodel look substantially identical to the object. In one embodiment, themodel can be printed by the 3D printer so that the depth information ofthe object surface is captured in the data received by the 3D printerwhich it transfers to the model it prints. In one embodiment, thecaptured reflectance data is conveyed to the 3D printed model via therelightable holographic techniques as detailed herein. The 3D printedmodel which comprises both the depth and light interaction attributes ofthe actual object will look more realistic than a model obtained from a3D printer.

In some embodiments, the reflectance data for the object is printed outas a relightable hologram which is affixed to the 3D printed model.Holography is a technique to record lighting information of an objectand to reproduce it at a later time in the absence of the object therebyproducing an illusion that the object is present. In order to generate ahologram of an object, the object is illuminated with a light sourcesuch as a coherent light source like a laser or spectrally filteredlight source. The light reflected off the object is combined with areference beam which may be direct light from the light source. Thepattern resulting from the interference of the reflected beam with thereference beam is captured on a recording medium like a photograph.However, the recorded pattern captured by employing holography containsmuch more information than a simple focused image such as a photograph.This enables reproducing a three dimensional image of the object whichcauses the illusion that the object is present.

FIG. 1 is a flowchart 100 that illustrates a methodology of generating amodel of an object in accordance with some embodiments. The methodbegins at 102 wherein a model of the object is obtained. The object canbe a real object such as but not limited to a person, an animal or otherreal-world living/non-living object in some embodiments. In someembodiments, the object can be a virtual/imaginary object that may ormay not exist in the real-world which may comprise without limitationliving or non-living entities. Attributes of such virtual objects suchas but not limited to, the appearance which can comprise the shape,size, colors, texture, reflectance properties, and other visible andinvisible properties may be determined by their creators/designers. Themodel of the real or virtual object can be obtained at 102 via thesubtractive or additive processes as described herein. An image ofobject is input to the 3D printer. Again, based on whether the object isa real object or a virtual object, the image input to the 3D printer canbe a photograph from a camera or a processor-generated image. A model isgenerated from the received image by the 3D printer in an additiveprocess by repeatedly layering materials such as, powdered resin. As thedetailed structure of the object can be reproduced by the 3D printer,the depth information of the object's surface can be accuratelyrepresented by the 3D model. In an embodiment, the model comprises acolored surface which includes one or more of red, green blue, cyan,yellow or the like. In an embodiment, the model is made to be the samesize as the object.

At 104, the lighting information of the object is obtained. The lightinginformation obtained at 104 can be representative of not only thereflection but also of other complex phenomenon that occur when lightinteracts with an object surface. This can include other phenomenon suchas but not limited to light absorption and/or transmission which includewithout limitation diffraction and scattering effects. In oneembodiment, the lighting information at 104 can be obtained from imagingapparatus such as a light stage. In an embodiment, the light stageincludes in addition to other components, a camera and light sourceswhose intensities can be controlled. The light stage is configured forgenerating gradient illumination patterns. The light sources areconfigured and arranged to illuminate the surface of the object with thegradient illumination patterns. The light reflected from the illuminatedsurface of the object is received by a camera which generates datarepresentative of the reflected light. In some embodiments, the data cancomprise interference patterns for generating holograms of the objectsurface. In some embodiments, the data from the camera is processed by acomputing system so as to estimate the surface normal map of the surfaceof the object.

A specular normal map and a diffuse normal map of the surface of theobject can be generated separately, by placing polarizers on the lightsources and in front of the camera so as to illuminate the surface ofthe object with polarized spherical gradient illumination patterns. Inan embodiment, data from the light stage can be used to estimate otherattributes of the object surface. For example, techniques for modelinglayered facial reflectance consisting of specular reflectance, singlescattering, and shallow and deep subsurface scattering can be employed.Parameters of appropriate reflectance models can be estimated usingmodels as mentioned supra for each of these layers, e.g., from just 20photographs recorded by the light stage in a few seconds from a singleview-point.

In one embodiment, the lighting information at 104 can be obtained froma computing device. For example, object surface appearance can bemodeled utilizing bi-directional reflectance distribution functions(“BRDFs”). As described herein, the BRDF of a surface can be evaluatedfrom mathematical functions which are derived using analytical models.Different models can be employed for determining the reflectancecharacteristics of different types of materials. In fact, libraries ofmeasured BRDF data can also be accessed from multiple sources. In oneembodiment, the light interaction properties of an object surface can becalculated mathematically in a computer using path tracing. Path tracingis a computer graphics Monte Carlo method of rendering images ofthree-dimensional scenes. In fact, technology exists in CG (computergraphics) rendering to calculate even complex light interactionproperties such as dispersion and scattering at sub millimeterresolution, such as, for 1 pixel. The lighting information of aplurality of regions of the object surface can thus be obtained at 104via one or more of physical or mathematical procedures.

The lighting information is obtained at 104 for a plurality of regionsof the object surface. In some embodiments, the lighting information canbe collected at 104 for regions of the object surface. The area of eachregion can be determined based on the desired resolution of theresultant image. The greater the desired resolution, the smaller will bethe area of each region. Accordingly, object surface can behypothetically divided into a plurality of regions for obtaining thelighting information.

The lighting information obtained at 104 for the plurality of objectregions can encode multiple viewing angles or multiple lightingconditions depending on the methodology adopted for obtaining thelighting information. For example, each pixel of a digital hologramencodes multiple viewing angles for a given light source. The lightinginformation for such a digital hologram is captured via incrementalcamera movements while keeping the object and the light source at fixedpositions.

In some embodiments, the lighting information for each region of theobject surface can encode multiple lighting conditions which can be usedto print a relightable hologram. This can be achieved by keeping thecamera and the object at fixed positions while changing the lightsources and region-wise aggregation of the lighting information inaccordance with embodiments as detailed further infra.

At 106, the lighting information of the regions of the object surfaceobtained at 104 is printed out as a series of holograms. Each hologramof the series comprises or encodes the lighting information of one ofthe regions of the object surface. By the way of illustration and notlimitation, each hologram of the series can comprise the lightinginformation, such as the reflectance data of one of the regions of theobject surface. Therefore, reflectance data for each region of theobject surface obtained at 104 is printed out as a hologram at 106. Inan embodiment, the reflectance data for each region of the objectsurface is represented by the BRDF. Hence, the series of hologramsprinted out at 106 encode the BRDFs of the regions of the objectsurface. The hologram printed at 106 is thereby configured to create thecorrect wave front so that the hologram encodes all the differentlighting conditions that the object can be exposed to. In an embodiment,a single sheet comprising the series of holograms is printed out at 106.Various known methodologies such as those used by ZEBRA IMAGING can beused for obtaining the series of holograms.

In some embodiments, the method moves directly to step 110 foridentifying portions of the 3D printed model that correspond to theregions of the object surface so that the appropriate lightinginformation can be applied to the 3D printed model. A surface of theprinted 3D model can be hypothetically divided into portions in a mannersimilar to the object surface. By the way of illustration and notlimitation, the number of regions of the object surface can be equal tothe number of hypothetical portions of the 3D model surface. Therefore,each hypothetical region of the object surface corresponds to arespective portion of the model surface.

The method then proceeds to step 112 for affixing the holographic sheetto the model, thus step 108 can be eliminated. At 112, the sheet ofholograms generated at 106 is attached to the 3D printed model such thateach of the holograms that comprises lighting data of one particularregion of the object surface corresponding to a particular portion ofthe model is positioned and affixed to that particular portion of themodel. For example, the sheet of holograms can be positioned and shrinkwrapped over the model such that a particular hologram that compriseslighting data of a specific region of the object surface is affixed tothe corresponding portion of the model.

In some embodiments, the method moves to step 108, wherein the sheetcomprising the series of holograms is cut up or divided into a pluralityof segments or a plurality of holographic flakes. In an embodiment, thesheet is divided such that each segment or flake comprises one hologramof the printed series of holograms. As a result of such separation, aplurality of printed holograms are obtained at 108 wherein each printedhologram comprises reflectance data of one of the regions of the objectsurface. Again, it can be appreciated that the number of printedholograms or holographic flakes generated at step 108 can be equal tothe number of object surface regions or correspondingly the number ofmodel surface portions. By the way of illustration and not limitation,the area of the printed holograms obtained at 108 can extend between0.000001 sq. mm. to 0.25 sq. mm. In an embodiment, the sheet can bedivided such that a piece of the sheet comprises two or more holograms.Hence, it may be appreciated that the pieces of holograms generated at108 can comprise one or more holograms each of which encodes reflectancedata of respective regions of the object surface.

In some embodiments, the method moves from step 108 to 110 wherein theportions of the 3D model corresponding to the regions of the objectsurface are identified. The flakes of the holographic sheet generated at108 are attached or affixed to the corresponding portions of the modelat 112. Since the 3D printing process is an additive process, a 3Dprinter can be programmed to affix the flakes of the holographic sheetto the corresponding portions of the 3D model as the final layer of themodel is being printed. For example, a mechanical inkjet of the 3Dprinter can be programmed to eject the plurality of flakes of theholographic sheet when building the respective portions of the 3D model.

As a result of the process detailed in FIG. 1, a 3D printed model isobtained which not only conveys the depth information of an objectsurface but is further endowed with the reflectance properties of theobject surface. When light is incident on such 3D printed model, it isreflected in a manner that is substantially identical to the actualobject. This is because the holographic pieces on the model are encodedwith the reflectance properties of the actual object surface andaccordingly mimic the reflectance properties of the object surface.

It can be appreciated that the procedures of the holographic sheet beingwrapped as a whole or being separated are described separately in theflowchart 100 only by the way of illustration and not limitation. Infact, the steps need not be mutually exclusive when generating a 3Dmodel and may be used together when generating a single 3D model. Forexample, there can be portions where a holographic sheet comprisingmultiple holograms is affixed or wrapped around a portion of the 3Dmodel while segments or flakes of the holographic sheet comprisingindividual holograms are affixed to other portions of the same 3D model.

FIG. 2 is a flowchart 200 that details a methodology of generating amodel of an object in accordance with some embodiments. The methodbegins at 202 wherein a model made of a reflective material such as ametal is obtained. The model can be made of metals such as gold orsilver. In some embodiments, the model is the same size as the objectand can be obtained via additive processes from a 3D printer or byetching or chiseling a metal block/sheet. At 204, the lightinginformation comprising reflectance data of regions of the object isobtained. In an embodiment, the reflectance data obtained at 204 issimilar to the reflectance data obtained at 104. In an embodiment, ifthe reflectance data of the object is recorded at 104 then such data canbe reused thereby rendering step 204 redundant. At 206, various portionsof the model surface that correspond to a respective region of theobject are identified. In an embodiment, the model surface can be thesame size as the object region and accordingly, the plurality ofportions identified on the model can be the same size as the regionsidentified on the object surface. At 210 the lighting informationobtained for each region of the object surface is encoded on thecorresponding portion of the model surface.

In an embodiment, the lighting information comprises reflectance datafor the region for light rays incident on the region from differentdirections. Thus, the reflectance data for a plurality of lightingconditions is encoded on the model surface for each region. In anembodiment, the model can be printed by the 3D printer and the lightinginformation which includes the reflectance data can be etched on it forexample, by a holographic printer.

In an embodiment, the reflectance data can comprise the BRDF of eachregion of the object surface and the holographic printer can etch adiffraction grating on the surface of the metallic model which changesthe refractive index of the model surface. When the metallic model isilluminated by a light source which serves as a reference beam, thediffraction grating will be operative to produce a hologram whichreflects light in a manner that mimics the light reflection by theobject. This mitigates the need for printing, dividing and attaching theholographic film to the model surface as described in FIG. 1. In anembodiment, the metallic model as described herein can be used to modelmetallic objects.

It may be appreciated that different portions of an object surface maypossess different attributes. While some regions of the object surfacecan be diffusive other portions of the object surface may be glossier.Accordingly, FIG. 3 is a flowchart 300 that details the method ofgenerating a model of an object in accordance with some embodiments. Themethod begins at 302 wherein the lighting information comprising, forexample, the reflectance data of a region of the object surface isobtained by a computing device attached to a 3D printer. In anembodiment, the reflectance data of the object is obtained usingapparatus such as the light stage. In an embodiment, the reflectancedata is analyzed by the computing device at 304 to determine the natureof the object surface. At 306, it is determined if the object surfacehas a matte finish or if the object surface has a more glossy finishbased on the analysis at 304. For example, if the reflectance data fitsthe Lambertian model, it may be determined at 306 that the objectsurface has a matte finish else it can be determined that the objectsurface has a glossy finish. If the object surface has a matte finish,then the ink of the appropriate color can be squirted to generate alayer of the 3D model as shown at 308. If it is determined that theportion of the object surface of the object is glossier, that particularportion of the object surface is printed or built up by squirting ink at310 and subsequently, the holographic data is applied at 312, forexample, by attaching tiny flakes of a holographic film in accordancewith embodiments described herein. Hence, it may be appreciated that anentire model does not need to be covered by the holographic print inaccordance with the embodiments described herein. Rather, portions ofthe model surface corresponding to the glossier surfaces of the objectsmay be covered with the holographic prints that are generated inaccordance with embodiments detailed further infra while portions of themodel corresponding to more diffusive object surfaces may receive mattefinish via regular 3D printing.

In some embodiments, relightable holograms are used for the glossiersurfaces as detailed in FIG. 3. Generally holograms encode varyingviewpoints under fixed lighting conditions. For example, given a fixedobject and a light source, a camera is programmed for microscopic,incremental movements to generate data for printing out a digitalhologram. Therefore, when a viewer changes a viewing position whenlooking at the printed hologram, the hologram appears to have moved tothe viewer. FIG. 4 shows a flowchart 400 that details a methodology ofgenerating the lighting information for a relightable hologram which canbe used with the 3D printed model of the object in accordance with someembodiments. A relightable hologram in accordance with some embodiments,encodes multiple lighting conditions from a single view point. Inaccordance with some embodiments, the reflectance data is collectedphysically for the relightable hologram by maintaining a real-worldobject and the camera in fixed positions while moving the lightsource(s) around the object. Apparatus such as known in the art forcollecting the reflectance data can comprise without limitation, a lightstage or a portable light stage which may be used to execute a method asdetailed in FIG. 4 for example. In some embodiments, the reflectancedata can be generated entirely by a computing device for either thereal-world object or a virtual object for a plurality of lightingconditions. In some embodiments, the reflectance data can also bepartially generated by programming the computing device to extrapolatethe data obtained for a real-world object for a subset of the pluralityof lighting conditions using known mathematical models.

Collecting reflectance data for a real-world object using a physicalprocedure begins at 402 wherein the object whose lighting information isto be collected is illuminated from one or more directions with one ormore light source(s). In some embodiments, the light source(s) is fixedto the dome-like structure of the light stage and the object is placedin the middle of the dome. In other embodiments the light sources areindependently mobile. At 404, the region information of the objectsurface is obtained. For example, the regions can comprise microscopicareas on the object surface wherein the number of pixels comprised in animage of the region or microscopic area is estimated for example, by acomputing device. The light source(s) used to illuminate the object isprogrammed to move at 406 based on the region information obtained at404. In an embodiment, the light source is programmed for minutemovements ranging from 0.5 mm-1.0 mm and the number of times the lightsource moves may depend on the number of regions on the object surface.For example, if the desired resolution of an image of the object surfaceis 300 PPI (pixels per inch), the light source can be moved 300 timesper inch when collecting the reflectance data of the object surface. At408, the lighting information of a region of the object surface iscaptured. In an embodiment, the lighting information can comprise thedata associated with the reflectance of the plurality of light raysoriginating from the plurality of light sources and incident on a regionof the object surface.

When the lighting information of a region is obtained at 408, it isdetermined at 410 if there are more regions whose lighting informationneeds to be collected. If yes, the light source is moved as shown at 412and the procedure returns to 408 wherein the lighting information of thenext region is obtained. The loop comprising steps 408, 410 and 412 canbe repeated until all the regions of the object surface are imaged. At414, it is determined if more lighting conditions exist that need to beapplied to the object for collecting the reflectance data. If yes, themethod moves to 416 wherein the new lighting conditions are selected.New lighting conditions selected at 416 can comprise without limitation,different light sources wherein various values of RGB can be applied tothe object for obtaining further reflectance data. Upon selecting thenew lighting conditions at 416 the method loops back to step 402 whereinthe object is illuminated with the newly selected lighting conditionsand reflectance data is obtained by moving the light sources as detailedsupra.

The imaging procedure described in FIG. 4 generates numerous images ofthe object for each lighting condition. For example, the procedure ofFIG. 4 when executed for a single lighting condition can generateapproximately 8000 images. FIG. 5 details a method of generating arelightable hologram in accordance with some embodiments. The methodbegins at 502 with obtaining lighting information of a plurality ofregions of the object under a plurality of lighting conditions asdetailed in FIG. 4. In an embodiment, region-wise reflectance data canbe obtained at 502 as a series of images of the object illuminated byone or more light sources from different positions. At 504, the lightinginformation of the plurality of regions of the object surface thusobtained is aggregated. In some embodiments, images of each region ofthe object that were collected under the plurality of lightingconditions are overlaid on each other to aggregate the lightinginformation. As the images are taken from a single camera view point(albeit different lighting conditions) the object appears to be lit bywhite light when they are overlaid on each other. This is in contrast tothe traditional methodology of collecting lighting information from aplurality of viewpoints for generating a digital hologram whereinaggregating such lighting information would result in fuzzy,out-of-focus images. It may be appreciated by those skilled in the artthat for minute areas or regions of the object surface as describedherein, the view angle may not make as significant contribution to theappearance of the model as proper reflectance would.

A holographic print of the aggregated lighting information for eachregion of the object is obtained at 506. In some embodiments, theaggregated lighting information for each of the plurality of regions isrecorded on a light sensitive medium from which the holographic print isgenerated using known methods. Examples of photo-sensitive media thatcan be used to generated holograms can comprise without limitationphotographic emulsions, photopolymers, photoresists and similarsubstances. The holographic print obtained at 506 comprises a pluralityof relightable holograms each of which encodes multiple lightingconditions for each region of the object as opposed to multiple viewingangles that are encoded in a normal holographic pixel. Thus, while anormal hologram is able to provide image data from different viewingangles, a relightable hologram in accordance with embodiments describedherein provides reflectance data when illuminated by the appropriatelighting conditions.

In some embodiments, if the relightable hologram generated at 506 is litwith a light source from a direction substantially similar to thosepresent when the reflectance data was collected, then the light isreflected in a substantially similar manner as the object whose lightinteractions were recorded at 502. Thus, when a 3D model of an object iscovered with relightable holograms as described herein, the depth andlight interaction data are both captured thereby generating a morerealistic replica of the object than what would otherwise have beengenerated by just the 3D printer.

FIG. 6 is an illustration 600 that depicts the lighting informationcomprising a series of images 602 of an object obtained in accordancewith some embodiments. One or more light sources can be programmed forminute movements while the camera and the object remain in fixedpositions. It can be appreciated the image series 602 with 25 images isshown and discussed herein only by the way of illustration and notlimitation. Any number of images can be generated for the image series602 based on the various positions of the light source(s). Each image604 of the plurality of images 602 captures the lighting information ofthe regions or microscopic areas of the object for a given position ofthe light source(s). The plurality of images 602 were generated bymoving serially the light sources, for example, from the left side ofthe object to its right side while keeping the object and camera infixed positions. Accordingly, considering the series of images 602 as a5×5 matrix, the image at the position 5×5 is a mirror image of the imageat the position 1×1. A plurality 606 of such image series can begenerated by employing a plurality of lighting conditions. Light sourceswith varying attributes such as but not limited to the intensities,color/wavelength, type of light can be used to generate the plurality606 of image series.

The lighting information from each corresponding individual image 604from each series 602 of the plurality 606 of series for a given imagepixel are overlaid and the resulting images are printed out as a sheetof relightable holograms 608 comprising a plurality of tiny holograms610 in accordance with some embodiments. For example, assuming eachimage at the position 1×1 in the plurality of series 606 is indicativeof the lighting information of the imaged object surface when the lightsources and the object are at a particular position, a relightablehologram of the object surface is generated by superimposing oroverlaying each of the 1×1 images from the plurality of image series606. Thus, a relightable hologram is generated by superimposing the eachN×N image indicative of a particular light-source/object position withother images indicative of the same position from the various imagesseries 606.

As each hologram 610 of the relightable hologram 608 that encodeslighting information of a plurality of lighting conditions of a singlecorresponding region of the object surface, applying one of theplurality of lighting conditions on the sheet of relightable hologram608 results in a view that would substantially replicate what the objectsurface looks like when lit under that lighting condition. The effectcan be further enhanced to look more realistic by application of therelightable holographic pixels on a 3D printed model of the objectsurface. The process as outlined in embodiments herein can aid ingenerating a more realistic replica of objects such as but not limitedto a person's face which can thus be generated from the 3D printed modelthat is endowed with not only the depth information but also with theperson's facial reflectance data.

FIG. 7 shows a model 700 of an object generated in accordance withembodiments detailed herein. In some embodiments, the depth and lightinginformation of the object can be obtained by executing a physical datacollection process employing tools such as the light stage. The physicalstructure of the model that shows the depth information is produced by a3D printer. The lighting information is transferred to the model via theholographic sheet comprising the relightable holograms as detailedherein. Based on the lighting information of the object, there can becertain portions such as for example, the tires 702 of the model 700that can have matte finish and do not require holograms while otherportions such as the body 704 and windshield 706 of the car haveholographic flakes/sheet affixed thereto.

FIG. 8 illustrates internal architecture of a computing device 800 inaccordance with some embodiments. The computing device 800 or anotherdevice substantially similar to it can comprise modules to generate amodel and the attributes of a virtual object by an artist for furthermodelling in accordance with embodiments described herein. The computingdevice 800 can be further configured to include programming logic forgenerating reflectance data of a virtual object or a real object. Insome embodiments, certain reflectance information of the real object canbe obtained via executing a physical procedure as detailed herein whileother reflectance information can be generated by programming logicexecuted by the computing device 800. In some embodiments, the computingdevice 800 can also be used to operate a data gathering apparatus suchas a light stage as detailed herein. Moreover, the computing device 800can include modules to drive a printer which can comprise withoutlimitation, a 3D printer to print a 3D model of the object and attachthe holographic sheet comprising the lighting information to the printedmodel.

The internal architecture of the computing device includes one or moreprocessing units (also referred to herein as CPUs) 812, which interfacewith at least one computer bus 802. Also interfacing with computer bus802 are persistent storage medium/media 806, any audio devices 808,network interface 814, memory 804, e.g., random access memory (RAM),run-time transient memory, read only memory (ROM), etc., media diskdrive interface 820 for a drive that can read and/or write to mediaincluding removable media such as floppy, CD-ROM, DVD, etc., media,display interface 810 as interface for a monitor or other displaydevice, input device interface 818 for input devices such as a keyboard,pointing devices such as a mouse and miscellaneous other interfaces 822not shown individually, such as parallel and serial port interfaces, auniversal serial bus (USB) interface, and the like.

Memory 804 interfaces with computer bus 802 so as to provide informationstored in memory 804 to CPU 812 during execution of software programssuch as an operating system, application programs, device drivers, andsoftware modules that comprise program code, and/or computer-executableprocess steps, incorporating functionality described herein, e.g., oneor more of process flows described herein. CPU 812 first loads softwaremodules for the computer-executable process steps from storage, e.g.,memory 804, storage medium/media 806, removable media drive, and/orother storage device. CPU 812 can then execute the software modules inorder to execute the computer-executable process steps. Stored data,e.g., data stored by a storage device, can be accessed by CPU 812 duringthe execution of computer-executable process steps.

Persistent, non-transitory storage medium/media 806 is a computerreadable storage medium(s) that can be used to store software and data,e.g., an operating system and one or more application programs.Persistent storage medium/media 806 can also be used to store devicedrivers, such as one or more of a digital camera driver, monitor driver,printer driver, scanner driver, or other device drivers, content andother files. Persistent storage medium/media 806 can further includeprogram modules and data files used to implement one or more embodimentsof the present disclosure.

FIG. 9 is a 3D printer 900 for printing 3D models with holographic datain accordance with some embodiments described herein. As describedsupra, the 3D printer 900 can be connected to a controller, such as, acomputing device 900 that provides the software for generation and/orselection of the models to be printed. Specialized 3D printing softwarepackages are available that enable generating the models on a displayscreen of the computing device 900. Based on the modelgenerated/selected by the user, the computing device 900 can control the3D printer 900 to produce or print the model. Although shown asdisparate units herein, it can be appreciated that the computing device800 can also be integrated with the 3D printer to form a single unit inaccordance with some embodiments.

The electronics 912 of the 3D printer 900 comprises at least a processor914 and a non-transitory processor or computer readable non-transitorystorage medium 916. The processor 914 controls the various parts of the3D printer 900 based on the programming logic stored on thenon-transitory storage medium 916 to produce 3D printed models withholographic data attached thereto. A sheet comprising a plurality ofrelightable holograms that comprise lighting information of the objectsurface to be printed is fed to the holographic sheet cutter 904 forseparation into a plurality of printed holograms for attaching to the 3Dprinted model as it is being printed. In some embodiments, the pluralityof printed holograms can be obtained externally from a disparateapparatus for separation into a plurality of printed, relightableholograms.

The plurality of printed, relightable holograms obtained either from thecutter 904 or externally in accordance with embodiments described hereinare fed to the extruder 906. The extruder 904 is made up of an extrudingmechanism comprising a tank to contain the 3D printing ink which caninclude plastics like colored resins and a nozzle to extrude the 3Dprinting ink to produce the 3D printed model. The extruding mechanismcan be further adapted to emit or output each of the relightableholograms of the series as the corresponding portion of the model isprinted. In some embodiments, the electronics 912 of the 3D printer 900is programmed to enable the extruder 904 to emit particular relightableholograms as the outer surface of the corresponding portion of the 3Dmodel is printed.

The adjustable printer bed 908 in combination with the extruder movingmechanism 902 enables 3D printing by the extruder 2004. The extrudermoving mechanism 902 can comprise one or more adjustable frames 922 andX-Y-Z motors 924. The extruder 902 is mounted on the frames 922 that arefitted with the X-Y-Z motors that enable moving the extruder 904 alongone or more of the X-Y-Z axes on the frames 922. In addition, theadjustable printer bed 908 onto which the extruder 906 emits the ink canbe adjusted adding another dimension of flexibility to the 3D printer900. A cooling mechanism 910 such as a fan is also included in the 3Dprinter 900 so that upon being printed, the 3D model is cooled. The 3Dprinter 900 is therefore able to print realistic models with depthinformation and lighting information in accordance with embodimentsdescribed herein.

For the purposes of this disclosure a computer readable medium storescomputer data, which data can include computer program code that isexecutable by a computer, in machine readable form. By way of example,and not limitation, a computer readable medium may comprise computerreadable storage media, for tangible or fixed storage of data, orcommunication media for transient interpretation of code-containingsignals. Computer readable storage media, as used herein, refers tophysical or tangible storage (as opposed to signals) and includeswithout limitation volatile and non-volatile, removable andnon-removable media implemented in any method or technology for thetangible storage of information such as computer-readable instructions,data structures, program modules or other data. Computer readablestorage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM,flash memory or other solid state memory technology, CD-ROM, DVD, orother optical storage, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic storage devices, or any other physical ormaterial medium which can be used to tangibly store the desiredinformation or data or instructions and which can be accessed by acomputer or processor.

For the purposes of this disclosure a module is a software, hardware, orfirmware (or combinations thereof) system, process or functionality, orcomponent thereof, that performs or facilitates the processes, features,and/or functions described herein (with or without human interaction oraugmentation). A module can include sub-modules. Software components ofa module may be stored on a computer readable medium. Modules may beintegral to one or more servers, or be loaded and executed by one ormore servers. One or more modules may be grouped into an engine or anapplication.

Those skilled in the art will recognize that the methods and systems ofthe present disclosure may be implemented in many manners and as suchare not to be limited by the foregoing exemplary embodiments andexamples. In other words, functional elements being performed by singleor multiple components, in various combinations of hardware and softwareor firmware, and individual functions, may be distributed among softwareapplications at either the client or server or both. In this regard, anynumber of the features of the different embodiments described herein maybe combined into single or multiple embodiments, and alternateembodiments having fewer than, or more than, all of the featuresdescribed herein are possible. Functionality may also be, in whole or inpart, distributed among multiple components, in manners now known or tobecome known. Thus, myriad software/hardware/firmware combinations arepossible in achieving the functions, features, interfaces andpreferences described herein. Moreover, the scope of the presentdisclosure covers conventionally known manners for carrying out thedescribed features and functions and interfaces, as well as thosevariations and modifications that may be made to the hardware orsoftware or firmware components described herein as would be understoodby those skilled in the art now and hereafter.

While the system and method have been described in terms of one or moreembodiments, it is to be understood that the disclosure need not belimited to the disclosed embodiments. It is intended to cover variousmodifications and similar arrangements included within the spirit andscope of the claims, the scope of which should be accorded the broadestinterpretation so as to encompass all such modifications and similarstructures. The present disclosure includes any and all embodiments ofthe following claims.

What is claimed is:
 1. A method comprising: printing, at a devicecomprising a processor with a first physical material, a holographicsheet comprising a series of holograms, each hologram of the seriescomprising at least one holographic pixel that encodes lightinginformation of a respective one of a plurality of regions of an objectsurface different from that of others of the plurality of regions;dividing, by the device, the printed holographic sheet into a pluralityof separate physical holographic flakes, each holographic flakecomprising a respective hologram of the series encoding the lightinginformation of the respective one of the plurality of regions of theobject surface, the number of the divided holographic flakes being equalto the number of the plurality of regions of the object surface;printing, by the device, a physical model of the object with a secondphysical material, a surface of the physical model comprising aplurality of portions, each portion corresponding to the respective oneof the plurality of regions of the object surface; and attaching, by thedevice, the holographic flakes to the surface of the printed physicalmodel, each holographic flake attached to that portion of the physicalmodel which corresponds to the respective one of the plurality ofregions of the object surface.
 2. The method of claim 1, whereinattaching the printed series of holograms to the model furthercomprises: wrapping a holographic sheet comprising at least a subset ofthe series of printed holograms on the model.
 3. The method of claim 1wherein the model of the object is a 3-dimensional model.
 4. The methodof claim 3, printing a physical model of the object further comprising:receiving, by the device, a three dimensional image of the object; andprinting, by the device, the three dimensional model of the of theobject from the three dimensional image.
 5. The method of claim 4, eachof the plurality of printed holograms that comprises lightinginformation of the respective region of the object surface is affixed tothe corresponding portion of the model during the printing.
 6. Themethod of claim 1, wherein the printed series of holograms arerelightable holograms.
 7. The method of claim 1 wherein the model of theobject is a 2-dimensional model.
 8. The method of claim 1, wherein anarea of a printed hologram ranges between
 0. 000001 sq. mm. to 0.25 sq.mm.
 9. The method of claim 1, wherein the object is a real-world object.10. The method of claim 1, wherein the object is a virtual object. 11.An apparatus comprising: a processor; a storage medium for tangiblystoring thereon program logic for execution by the processor, theprogram logic comprising: printing logic, executed by the processor, forprinting at the apparatus with a first physical material, a holographicsheet comprising a series of holograms, each-hologram of the seriescomprising at least one holographic pixel that encodes lightinginformation of a respective one of a plurality of regions of an objectsurface different from that of others of the plurality of regions;dividing logic, executed by the processor, for dividing the printedholographic sheet into a plurality of separate physical holographicflakes, each holographic flake comprising a respective hologram of theseries encoding the lighting information of the respective one of theplurality of regions of the object surface, the number of the dividedholographic flakes being equal to the number of the plurality of regionsof the object surface; printing logic, executed by the processor, forprinting a physical model of the object with a second physical material,a surface of the physical model comprising a plurality of portions, eachportion corresponding to a respective one of the plurality of regions ofthe object surface; and attaching logic, executed by the processor, forattaching holographic flakes to the surface of the printed physicalmodel, each holographic flake attached to that portion of the physicalmodel which corresponds to the respective one of the plurality ofregions of the object surface.
 12. The apparatus of claim 11, whereinattaching the printed series of holograms to the model furthercomprises: logic executed by the processor for wrapping a holographicsheet comprising at least two of the series of printed holograms on themodel.
 13. The apparatus of claim 11, the model of the object being a3-dimensional model.
 14. The apparatus of claim 13, the program logicfurther comprising: image receiving logic, executed by the processor,for receiving a three dimensional image of the object; and logicexecuted by the processor for printing the three dimensional model ofthe of the object from the three dimensional image.
 15. The apparatus ofclaim 11, wherein the printed series of holograms are relightableholograms.
 16. A non-transitory computer readable storage mediumcomprising processor-executable instructions for: printing, with a firstphysical material, a holographic sheet comprising a series of holograms,each hologram of the series comprising at least one holographic pixelthat encodes lighting information of a respective one of a plurality ofregions of an object surface different from that of others of theplurality of regions; dividing the printed holographic sheet into aplurality of separate physical holographic flakes, each holographicflake comprising a respective hologram of the series encoding thelighting information of the respective one of the plurality of regionsof the object surface, the number of the divided holographic flakesbeing equal to the number of the plurality of regions of the objectsurface; printing a physical model of the object with a second physicalmaterial, a surface of the physical model comprising a plurality ofportions, each portion corresponding to a respective one of theplurality of regions of the object surface; and attaching theholographic flakes to the surface of the printed physical model, eachholographic flake attached to that portion of the physical model whichcorresponds to the respective one of the plurality of regions of theobject surface.
 17. The computer readable storage medium of claim 16,the instructions for attaching the printed series of holograms to themodel further comprise processor-executable instructions for: wrapping aholographic sheet comprising at least a subset of the series of printedholograms on the model.